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Abstract 

This  raport  docusronts  a  collection  of  new  techniques 
for  image  smoothing,  and  gives  examples  of  their  perform* 
anca.  The  techniques  involve  averaqinq  over  half-neigh- 
borhooda.  weighted  averaging,  and  averaging  based  on 
local  property  probabilities. 
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1.  Introduction 


A  wide  variety  of  methods  have  been  proposed  for  smoothina 
noisy  images;  see  (1)  for  an  introduction  to  this  subject.  Most 
of  these  methods  involve  some  type  of  local  averaging,  since  in 
a  uniform  region,  averaging  preserves  the  mean  gray  level 
while  reducing  the  variability.  However,  simple  local  averag¬ 
ing  blurs  edges,  which  is  undesirable.  A  number  of  methods 
havt.-  been  devised  to  preserve  edge  sharpness  whi’e  still  achiev¬ 
ing  some  degree  of  smoothing;  for  example,  one  can  take  a  local 
median  instead  of  a  local  mean,  or  one  can  average  only  a 
selected  subset  of  each  point's  neighbors,  chosen  in  such  a 
way  that  they  are  likely  to  belong  to  the  same  region  as  the 
point  itself.  Many  of  these  methods  are  compared  in  (2). 

This  rej'ort  describes  several  new  image  smoothing  techniques, 
and  ;;ves  examples  of  their  performance.  Section  2  deals  with 
techniques  based  on  averaging  a  point  with  five  of  its  consecu¬ 
tive  neighbors.  Section  3  uses  methods  based  on  weighted  averag¬ 
ing,  where  the  weight  given  to  a  neighbor  depends  on  how  close 
that  neighbor's  gray  level  is  to  that  of  the  point.  Section  4 
introduces  methods  that  make  use  of  global  probabilities,  rather 
than  gray  levels,  to  choose  the  neighbors  with  which  to  average. 
The  methods  were  successful  to  varying  degrees  ;  several 
of  them  seem  to  be  potentially  useful. 

For  comparison  purposes,  the  methods  were  all  tested  on  the 
same  two  pictures  that  were  used  in  (2).  These  pictures  are 
shown  as  parts  (a)  of  Figures  1-2.  Figure  la  is  a  128  x  128 


picture  of  an  octagon  of  gray  level  33  (on  a  scale  of  0-63) 
on  a  background  of  gray  level  28,  with  Gaussian  noise  of 
u  ■  0,  o*5  added.  rigure  2a  in  a  127  x  127  portion  of  s 
LANDSAT  picture,  with  Gaussian  noise  of  n  -  0,  o  ■  8  added. 

As  a  comparison  standard,  the  results  of  applying  one  of  the 
best  methods  used  in  (2)  to  these  two  pictures  are  shown  in 
Figures  1-2.  In  this  method,  each  point  is  averaged  with 
the  five  of  its  neighbors  that  are  closest  to  it  in  gray 
level.  (Rationale:  If  the  point  is  on  a  relatively  straight 
edge  between  regions,  about  five  of  its  neighbors  should  belong 
to  the  same  region  as  it  does.)  This  process  is  iterated; 
parts  b-h  of  Figures  1-2  show  iterations  1,...,7.  We  see  that 
this  results  in  strong  smoothing  but  does  not  blur  edges,  par¬ 
ticularly  in  the  case  of  Figure  2. 


2.  Half -neighborhood  methods 


The  five-neighbor  method  illustrated  in  Figures  1-2  is 
expected  to  choose  those  neighbors  which  lie  in  the  same  region 
as  the  given  {>oint,  when  the  point  lies  on  an  edge.  A  more 
refined  criterion  might  require  that  these  neighbors  be  conse¬ 
cutive,  since  if  the  point  is  on  a  relatively  straight  edge, 
it  should  have  five  consecutive  neighbors  that  belong  to  the 
same  region  as  it  does. 

To  define  such  a  criterion,  let  N  be  the  set  of  eight 
neighbors  of  the  point  P,  and  let  N  ■  U  where  Nj  is 

a  set  of  three  consecutive  neighbors  and  consists  of  the 

five  remaining  neighbors.  The  eight  possible  choices  of 
are  shown  below  (asterisks  denote  neighbors  in  N ^ ) : 

•  ••••  •  •  •  * 

P  p*  P*  P*  P  «P  *P  *P 

•  ••  •••  ••  * 

Let  N,  and  denote  the  average  gray  levels  of  and  N-> 

Two  criteria  based  on  the  U  N,  concept  were  investigated: 
a)  Choose  the  N ^  for  which  N-,  is  closest  to  the  gray  level  o 

P.  If  for  this  N,  we  have  >  avera9e  p  with 

N 2 :  otherwise  average  it  with  all  of  N.  Ilf  >  t 

we  assume  that  P  is  on  a  region  edge:  if  not,  we  assume 
that  it  is  interior  to  a  region.)  Results  using  five  itera¬ 
tions  of  this  method  are  shown  in  Figures  3-4  for  t  *  30, 

in  Figures  5-6  for  t  -  10,  and  in  Figures  7-8  for  t  *  0 

(i.e.,  we  always  average  P  with  ) •  There  is  little 
difference  among  the  cases,  and  the  results  are  more  blurry 
than  those  in  Figures  1-2. 


b)  Choose  the  for  which  In^-N^I  i»  greatest.  If  thia  is 

greater  than  t,  average  P  with  Njf  otherwise,  average 
it  with  all  of  N.  In  other  words,  we  pick  the  strongest 
edge  through  P's  neighborhood,  and  if  this  edge  is  strong 
enough,  we  average  P  only  with  the  ha  If -neighborhood  on 
its  own  side  of  the  edge.  Results  using  five  iterations  of 
this  method  are  shown  in  Figures  9-10  for  t  ■  30  and  in 
Figures  11-12  for  t  -  10;  the  value  of  t  makes  little 
difference.  For  the  LANDSAT  image,  this  method  produces 
excellent  smoothing  and  sharp  borders,  though  it  does  intro¬ 
duce  a  slight  jaggedness  in  the  borders. 


Neighbor-weighting  methods 
The  method  used  in  Figures  1-2  can  be  regarded  as  a 
"weighted"  averaging  scht.ne  in  which  the  five  neighbors 
that  have  gray  levels  closest  to  that  of  P  are  given  weights 
of  i  each  (as  is  P  itself),  while  the  three  remaining 
neighbors  axe  given  weights  of  zero.  A  "softer"  approach 
might  be  to  give  the  neighbors  weights  that  depend  on  the 
differences  of  their  gray  levels  from  that  of  P,  with  closer 
gray  levels  implying  higher  weights.  Two  versions  of  this  ap¬ 
proach  were  tried,  in  which  the  relative  weight  given  to  a 
neighbor  0  of  P  was  determined  as  follows: 

a)  4,  if  P-Q  !  5;  1,  otherwise 

b)  1  -  P-(j|/5,  if  i P-Q  •  5;  0,  otherwise 

Results  using  three  iterations  of  each  of  these  methods  are 
shown  in  Figures  13-14  and  15-16,  respectively.  We  see  that 
method  (a)  smooths  well,  but  also  blurs  slightly,  while  method 
(b)  does  not  eliminate  high-contrast  noise  (note  that  it  does 
no  smoothing  at  all  if  every  neighbor  differs  from  P  by  more 
than  five  gray  levels). 

Another  idea  which  was  also  tried  was  to  average  with  all 

neighbors  if  the  variability  of  the  neighborhood  was  small, 

and  with  only  the  most  similar  neighbors  if  it  was  large.  In 

the  implementation,  variability  was  measured  by  v  •  Z|Q~nl* 

0 

where  u  is  the  mean  gray  level  of  the  neighbors;  if  v  »  6, 
we  averaged  with  only  the  three  closest  neighbors,  and  if 


v  <  6,  with  all  eight  neighbors.  The  results,  shown  in 
Figures  17-18  for  three  iterations,  are  relatively  smooth 
and  sharp,  but  noise  is  preserved  in  the  vicinity  of  edges. 
This  method  is  related  to,  but  simpler  than,  the  method 
described  in  Section  2.8  of  (2J. 


Probability-based  methods 


Kather  than  choosing  neighbors  for  averaging  based  on 
their  gray  levels,  one  can  choose  them  based  on  the  probabili¬ 
ties  of  their  gray  levels,  as  estimated  from  the  histogram  of 
the  picture.  In  particular,  suppose  that  we  average  P  with 
those  of  its  neighbors  whose  probabilities  are  most  similar 
to  that  of  P;  if  P  is  on  an  edge  between  two  regions,  these 
neighbors  should  be  likely  to  lie  in  the  same  region  as  P. 

Unfor tunately ,  this  idea  does  not  work  well  in  practice,  as 
seen  from  Figures  19-20,  which  show  the  results  of  three  itera¬ 
tions  of  averaging  with  the  seven*  neighbors  having  most  similar 
probabilities;  considerable  blur  is  evident. 

More  interesting  results  are  obtained  if  we  average  with 
the  nciqhbors  that  have  highest  probabilities;  adjacent  to  an 
(unsharp)  edge,  this  will  favor  averaging  with  points  interior 
to  the  region,  which  should  have  higher-probability  gray  levels 
than  points  on  the  edge  slope  itself.  Figures  21-22  show  results 
of  seven  iterations,  using  the  seven*  most  pirobable  neighbors. 
Mere  small  regions  are  smoothed  out,  but  the  borders  between 
large  regions  remain  relatively  sharp. 

Another  possibility  is  to  base  the  neighbor  selection  on 

the  probability  of  the  difference  value  (e.g.,  digital  gradient 

or  magnitude  absolute  I.aplacian  value)  at  the  neighbor,  rather 

than  on  the  probability  of  the  neighbor's  gray  level.  If  P  is 

adiacent  to  an  edge,  the  neighbors  lying  in  the  region  should 

have  difference  value  probabilities  that  are  higher,  and  closer 

r - 

These  techniques  were  also  tested  using  five  neighbors  instead 
of  seven;  the  I.ANDSAT  picture  was  somewhat  less  blurred  when 
five  were  used,  but  using  the  five  most  probable  neighbors 
totally  erased  the  octagon. 


to  that  of  P,  than  the  neighbors  that  lie  on  the  edqe  ramp. 
Figures  23-24  and  25-26  show  results  of  three  iteration* 
using  the  seven  neighbors  with  closest  gradient  and  Laplacian 
probabilities,  respectively;  these  results  are  blurry.  Figures 
27-28  and  29-30  show  results  of  five  iterations  using  the  seven 
neighbors  with  highest  gradient  and  Laplacian  probabilities, 
respectively;  these  results  too  are  blurry,  but  the  Laplacian 
results  are  not  too  bad. 

Still  another  approach  is  to  choose  neighbors  based  on 
joint  probabilities  of  pairs  of  properties,  e.g.,  gray  level 
and  gradient,  gray  level  and  Laplacian,  or  gray  level  and  local 
average  gray  level.  Adjacent  to  an  edge,  these  joint  probabili 
ties  should  be  higher,  and  closer  to  that  of  P,  for  neighbors 
that  lie  in  the  same  region  as  P.  Figures  31-32,  33-34,  and 
35-36  show  three-iteration  results  for  the  closest  joint  pro¬ 
babilities  of  gray  level  and  gradient,  gray  level  and  Laplacian 
and  gray  level  and  local  average  gray  level,  respectively. 
Figures  37-3P,  19-40,  and  41-42  are  analogous  using  highest 

joint  probabilities.  Like  the  previous  methods,  all  of  these 
give  blurry  results. 


5.  Concluding  remarks 


All  of  the  methods  described  in  this  report  seemed  poten¬ 
tially  reasonable,  but  only  a  few  of  them  actually  achieved 
good  smoothing  without  blurring.  We  have  described  both  the 
successful  and  unsuccessful  methods,  since  even  the  negative 
results  are  useful  in  improving  our  insights  into  the  capabili¬ 
ties  of  such  methods. 
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Caption 

Seven  iterations  of  the  best-five- 
neighbor  method 

with  t  -  10 


Five  iterations  of  half -neighborhood 
method  (a)  with  t  -  30. 

Same  with  t  •  0 


Five  iterations  of  half-neighborhood 
method  (b)  with  t  -  30 

Same  with  t  *  10 


Three  iterations  of  neighbor-weighting 
method  (a) 

Same  for  method  (b) 

Same  for  method  based  on  neighborhood 
variability 

Three  iterations  of  averaging  with 
neighbors  having  moat  similar  probab¬ 
ilities 

Seven  iterations  of  averaging  with 
neighbors  having  highest  probabilities 

Three  iterations  of  averaging  with 
neighbors  having  orcst  similar  gradient 
probabi 1 ities 

Same  for  Laplacian 

Five  iterations  of  averaging  with  nei  h- 
bors  having  highest  gradient  probabi 1 ; t i rs 

Same  for  baplacian 


Three  iterations  of  averaging  with  neigh¬ 
bors  having  most  similar  (gray  level, 
gradient)  joint  probabilities 


Same  for  (gray  level,  Laplacian) 

Same  for  (gray  level,  average  grey 

level ) 

Analogous  to  Figures  31-36,  but  using 
highest  joint  probabilities 
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Addendum 


Another  method  based  on  neighborhood  variability,  analo¬ 
gous  to  the  last  method  described  in  Section  3,  was  also 
implemented.  Let  u  and  o  be  the  mean  and  standard  devia¬ 
tion  of  the  eight  neighbors  of  the  given  point  P.  Then 

If  a  I P-u I  « a,  P  is  averaged  with  its  four  most 
similar  neighbors 

otherwise,  P  is  averaged  with  all  eight  of  its 
neighbors 

Here  a  is  a  weighting  factor,  taken  to  be  l,  2,  and  1/2  in 
Figures  A-B,  C-D,  ar.d  E-F,  respectively,  each  of  which  shows 
five  iterations  of  this  process.  We  see  that  a  •  2  yields  too 
much  blur,  but  a  •  1  and  1/2  yield  sharp  results  in  which  the 
high-frequency  noise  has  been  eliminated.  Thus  this  method 
produces  very  good  smoothing.  |A  variation  which  was  also 
tried  was  to  average  with  the  neighbors  having  gray  levels 
on  the  same  side  of  w  as  P,  rather  than  with  the  most 
similar  neighbors,  when  a  p-w!  <  a.  However,  this  variation 
produced  unacceptable  effects  at  the  edges.) 
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